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Abstract 

In this article, we consider the dynamics in a neighborhood of a quasi-periodic torus 
which is invariant by a Hamiltonian flow, we discuss several notions of stability and we 
prove several results of instability when the frequency of the invariant torus is resonant. 


1 Introduction and main results 

1. Let n > 2 and T” := Consider a Hamiltonian system on ¥"■ x M"" associated to a 

I > 2, function of the form 

H{e,i)=uj-i + A{e)i-i + R{e,i), {e,i)eT'^xR^ (i) 

where • denotes the Euclidean inner product, u G M”, A : T” —Sym(n,M) is a map 
taking values in the space of real symmetric matrices of size n, and R{9,I) = 0^{I) is of 
order at least 3 in I. The set 7b := x {/ = 0} is invariant by the Hamiltonian flow of 77, 
it is a Lagrangian quasi-periodic torus with frequency w, and any such torus (on an arbitrary 
symplectic manifold) is of this form. 

Assuming that the frequency oj is non-resonant, that is, k ■ u ^ ^ for any k ^ 7R\ {0}, 
the invariant torus 7b possesses, generically, some stability properties. First, if 77 is smooth 
and the invariant torus is Kolmogorov non-degenerate (that is, the symmetric matrix Aq := 
fj.„ A{9)d9 is non-singular), then it is KAM stable: in any sufficiently small neighborhood 
of 7b j there is a set of smooth Lagrangian quasi-periodic invariant tori which has positive 
Lebesgue measure and density one at 7b, and which are obtained by a small deformation of 
the unperturbed invariant tori (those associated to the linear part of the Hamiltonian ([I|)). 
This result was first proved in |EFK14] . under extra assumptions on oj and 77 (namely that 
OJ has finite uniform Diophantine exponent and 77 is real-analytic), and the general case 
was subsequently obtained in [Boul4j . A consequence of the KAM stability is the following 
stability property: for any e > 0 sufficiently small, most solutions {9{t),I{t)) for which 7(0) 
has a norm equals to £ satisfy 

|7(t) - 7(0)1 <6^^, teR (2) 

where /i(e) is a function going to zero as e goes to zero (this function depends on the arithmetic 
properties of ui, see |Boul4] or the definition ([S|) below). 
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Still assuming u) non-resonant and without further assumptions, the invariant torus is also 
effectively stable (or Nekhoroshev stable): for all solutions one has the estimate 

\I{t)-im<efa{e), \t\<T{s) (3) 

where T{e) is at least of order e~^. More precisely, if H is smooth then T(e) is of order 
for any fixed I € N, and if H is real-analytic (or Gevrey smooth), this latter power 
estimate can be replaced by an exponential estimate. Proofs can be found in |Boul2j . |Boul3a) 
and |Boul3bj . In fact, in view of the results in |BFN14j . one may expect that generically, the 
above exponential stability estimate can be improved to a double exponential estimate. 

Finally, there is another more classical notion of stability: the invariant torus is topologi¬ 
cally stable (or Lyapounov stable) if it has a basis of invariant neighborhoods. Observe that 
for n = 2, if the invariant torus is KAM stable on each energy level sufficiently close to the 
zero energy level (which contains the invariant torus), then it is topologically stable, but in 
general this notion is not related to KAM stability or effective stability. Extrapolating on 
conjectures of Arnold (see |Arn94j i. one expects that generically, for n > 3, the torus is topo¬ 
logically unstable. However, essentially nothing is known (in the smooth case one only knows 
how to construct examples, see |Dou88j l and absolutely nothing is known in the real-analytic 
case (no examples are known). 

2. Our aim here is to investigate the case where one drops the requirement that the fre¬ 
quency uj is non-resonant. More precisely, our aim is to prove instability results for a generic 
Hamiltonian as in o, assuming that the frequency uj is resonant. 

To state our results, we start by assuming that the vector w is of the form 

cj = (0,w) € X (4) 

for some 1 < d < n — 1 and some non-resonant vector uj G R”“'^. This is no loss of generality, 
as by a linear symplectic transformation one can always put uj in this form. Up to a constant 
time change, we may also assume that |a;| = |w| = 1, where |. | denotes the supremum norm. 
Next we define, for Q > 1, the function T = by 

T(Q) := max{|A: • uj\~^ \ k = {ki,... ,kn-d) € 0 < |A:i| H-h \kn-d\ < Q} 

and for x > 4'(1) = = 1, the function A = by 

A(x) := suplQ > 1 I Q^iQ) < x}. 

For some constant k which depends only on n, we define, given a small parameter e > 0, 
another small parameter 

/r(e) := (A(Ke"^))“\ (5) 

Observe that /r(e) always converge to zero as £ goes to zero, more slowly than e: for instance, 
if UJ is periodic (a multiple of a rational vector), then |u(e) is exactly of order e, and if uj is 
resonant-Diophantine (meaning that it is not rational but the function T defined above grows 
at most as a power), then /r(e) is of order a power of e. In general, the speed of convergence 
to zero can be arbitrarily slow. 

Recall that we are considering dd as in ([1]) in a small neighborhood of the origin, which, 
without loss of generality, will be chosen to be the domain 

T" X Rse := T” X {/ G R*" I |/| < 3e} 
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for e > 0. Letting 


( 6 ) 


I:=ei, H{9,I) := sH{eJ), 

it is then equivalent to consider the Hamiltonian 

H{e, I) = I) = el) = uj ■ I + eA{9)I ■ I + e‘^R{9, /) (7) 

on the domain x B^, with the estimates 

|^lc'(T") — ^ ^2- (8) 

Here, |. |c*(T'‘xS 3 ) denotes the usual C^-norm on the domain T” x and | . the usual 

C^norm on 

Let us now dehne the map H —)> Sym(n, M) by 

A{9i,... ,9d) ■■= [ A{9i,...,9d,9d+i,...,9n)d9d+i...d9n- ( 9 ) 

Jjn-d 

Obviously, A is of class and \A\(ji(jd-^ < Ci. Our first generic assumption is as follows. 

(H.l) The function H —)■ Sym(n,M) is non-constant. Hence there exist 9* € and 

an integer i = i{9*), 1 < i < d, such that A* := dg^A{9*) G Sym(n,R) is non-zero. 

This assumption (^.1) is important to derive instability resnlts; in Theorem 0] below we 
will see that if (^.1) is not satisfied, then generically the invariant torus is KAM stable. 

Now given the assumption (A.l), let us define 

C* := {u € I A*v • u = 0}, 

that is C* is the isotropic cone of the quadratic form associated to the matrix A*. Since A* 
is non-zero, the complement of C* in MA is open, dense and of fnll Lebesgue measure. 

3. We can finally state our first result. 

Theorem 1. Let H he as in o satisfying ([8]) with I > 3 and with to as in Assume 
that (A.l) is satisfied, and fix G \ Cf with |/^| = 1. There exist positive constants 
ho = hoin, Cl, C 2 , A*, P), c = c{n, Ci,A*, P) and 5 = 6{n, Ci,A*,P) such that if 

0 < /i(e) < ho, 

then there exists a solution {9{t),I{t)) of the Hamiltonian system associated to ([I|) such that 
I{0)=eP, |/(r) - 1(0)1 > |Ii(r) - li(0)| > ce, t:=5£~^. 

Moreover, there exists a positive constant C = c{n,Ci,C 2 ,, A*, I^) such that 

max \Ij{T) - /j(0)| < Cen{e). 

d-\-l<j<n 
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Theorem [T] clearly shows that generically, the invariant torus is not effectively stable as 
the estimate ([3D cannot be satisfied for all solutions. It also shows that generically it is not 
KAM stable. Indeed, the statement implies the existence of “many” solutions for which /(O) 
has a norm equals to e but yet |/(t) —/(0)| > ce, for some positive time r and some constant c 
independent of e, provided the latter is sufficiently small. By “many” it is meant that we can 
find such solution for any choice of provided ^ C* and fi{s) < /tq where fiQ depends 
on on any sufficiently small ball around the origin, the set of initial action that are not 
concerned with Theorem [1] consists of small cusps around directions associated to C* , and 
the relative measure of this set goes to zero as the radius of the ball goes to zero. Hence the 
consequence ([ID of KAM stability cannot be true, and this shows that under our assumption 
(A.l), the invariant torus cannot be KAM stable. 

4. Theorem [1] implies the existence of solutions, starting arbitrarily close to the invariant 
torus, and for which the action variables deviate from its initial condition. Yet it does imply 
the existence of solutions for which the action variables deviate from zero (which corresponds 
to the invariant torus), or equivalently, solutions for which the action variables increase in 
norm. Under an extra generic assumption, this can be achieved. Let e* be the f-th vector of 
the canonical basis of M”, where the index i is the one given by (A.l). 

(A.2) The vector e* does not belong to C*, that is A*ei ■ e* := a* ^ 0. Reversing time if 
necessary, we may assume that a* < 0. 

Here’s our second result. 

Theorem 2. Let H he as in 0 satisfying ([HD with I > 3 and with oj as in (HI)- Assume 
that (A.l) and (A.2) are satisfied. There exist positive constants fiQ = fio{n,Ci,C 2 ,a*), 
c = c(n. Cl, a*) and 6 = 5{n, Ci,a*) such that if 

0 < ^(e) < ^0, 

then there exists a solution {6{t),I{t)) of the Hamiltonian system associated to ([ID such that 
l{0)=sei, |/(r)| > (1 + c)e = (1 + c)|/(0)|, r := 

Moreover, there exists a positive constant C = c(n, Ci, C 2 , a*) such that 

max \Ij{T) - lj{0)\ < C£^i{e). 

d-\-l<j<n 

This theorem implies in particular that given any sufficiently small ball B around 0 € M"’, 
the domain T'^xB cannot be invariant by the Hamiltonian flow. However, this is still far from 
proving that the invariant torus is not topologically stable. The statement of Theorem[2](and 
of Theorem [Tj also) only gives information on the behavior of solutions for a finite time scale 
of order e~^. To prove topologically instability, one needs to be able to control solutions over 
infinite interval of times, and this is a non-trivial task. The following question is therefore 
still open. 

Question 1. Consider a Hamiltonian H as in © and assume that u) is resonant. Is is true 
that, generically, the invariant torus 71 is topologically unstable? 
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One expects that the answer to this question is positive, even without the assumption that 
oj is resonant. As explained in the Introduction, the case where oj is non-resonant is much 
more complicated. One only knows examples of topologically unstable tori in the smooth 
category; in the analytic category, examples are not known, even examples with the weaker 
instability property expressed in Theorem [2j 

If OJ is resonant, examples are easily constructed, even in the analytic case. For instance, 
consider the Hamiltonian 

H{e,I) = OJ ■ I + A{ei)I ■ I 

where oj = (0,u)) G x with oj non-resonant, A{9i) is a diagonal matrix of the form 

Diag(oi(0i),..., On(0i)) with functions ai{9i), 1 < i < n, chosen such that oi is identically 
zero and a'j{6l) > 0 for some € T and some 2 < j < n. Fix the initial angle to be 
0(0) = (0*, 02(0),..., 0n(O)) with (02(0),... , 0n(O)) € arbitrary. Choosing any non-zero 
initial action proportional to ej, one easily sees that the corresponding solution is defined for 
all time and that the first action component is unbounded, and hence the invariant torus is 
not topologically stable. 

Coming back to Theorem [U we argued that it implies that the invariant torus cannot be 
KAM stable. Yet, for the same reason as we are not able to decide if topological instability 
holds in general (which is that we only control the solution on a finite time scale), we cannot 
decide also if the invariant torus is accumulated by other quasi-periodic invariant tori. 

Question 2. Consider a Hamiltonian H as in o and assume that oj is resonant. Is the 
invariant torus generically accumulated by other quasi-periodic invariant tori or is it gener- 
ically isolated? 

Looking at the example we give above, it is easy to observe that any initial action propor¬ 
tional to ei leads to a quasi-periodic invariant tori. Hence even the much simpler question 
below is left unanswered. 

Question 3. Construct a Hamiltonian H as in © with 00 resonant for which the invariant 
torus Tui is isolated. 

5. Coming back again to Theorem (TJ one drawback of the statement is that one has to 
exclude small cusps around isotropic directions of the symmetric matrix A*. If the latter is 
empty, one obtains a uniform statement. Let us introduce another condition. 

(A.3) The symmetric matrix A* is sign-definite. Reversing time if necessary, we may 
assume that it is negative definite, hence there exists a negative constant A* such that for all 
I G M”, A*I -I < A*|/|2. 

This condition is obviously much stronger than the conditions (A.l) and (A.2) together. 
Even though this condition is open, it is clearly no more generic. 

Our third result is as follows. 

Theorem 3. Let H be as in © satisfying ([5D with I > 3 and with oj as in ©• Assume that 
(A.3) is satisfied. There exist positive constants /iq = piQ{n,Ci,C 2 ,X*), c = c(n, Ci, A*) and 
S = 6{n, Cl, X*) such that if 

0 < ti{e) < /io, 
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then, given any Iq G M"" such that |/o| = 1, there exists a solution {9{t),I{t)) of the Hamilto¬ 
nian system associated to Cl) such that 


/( 0 )=eIo, |/(r) - 1 ( 0)1 >/i(r) -/i( 0 ) > ce, t := 5e ^. 

Moreover, there exists a positive constant C = c(n, Ci, 6 * 2 , A*) such that 

max |/j(r) - /j(0)| < Cefi{e). 

d-\-l<j<n 


6. Finally, as we already mentioned, let us discuss briefly what happens if the condition 
(A.l) is not satisfied. More precisely, consider the following assumption. 

(^.4) There exists a non-singular matrix Aq G Sym(n, M) such that for all (0i,..., 9^) G 
A{9i,... ,9d) = fo¬ 
under the following assumption, one can prove, as in |Boul4j . that the invariant torus is 
KAM stable provided the Hamiltonian is sufficiently smooth. 

Here’s our last result. 

Theorem 4. Let H be as in CD satisfying ([ 8 |) with I > Iq + 1 > 3n and with to as in ©• 
Assume that (A.4) is satisfied. Then there exist positive constants /tq = C*!) <^ 2 , Aq), 

Cl = c(n. Cl, 6 * 2 , Aq) and C 2 = C 2 (n, Ci, C 2 , Aq) such that if 

0 < /i(e) < ^ 0 , 

there exists a set /C C T” x B 2 e, which consists of Lagrangian quasi-periodic tori invariant by 
the Hamiltonian flow of H. Moreover, each tori is of class C^o, for Iq < Iq — 2n 1, and we 
have the measure estimate 

Cl VM^Leb(T” xB 2 e)< Leb(T’" x B 2 e \ /C) < C 2 ^/Jfl^Le^T^ x B 2 e). 

Again, as in |Boul4j . if the Hamiltonian is more regular (smooth, Gevrey smooth or real- 
analytic), then the invariant tori found are as regular as the Hamiltonian. But at variance 
with |Boul4j . one does not get a better measure estimate if the Hamiltonian is Gevrey smooth 
or real-analytic. 

2 Proof of the results 

1. The proof of Theorem [1] follows the strategy of |BK14j . The essential step in the argument 
is the construction of a global resonant normal, which was done in |Boul3a) and that we recall 
below. Proofs of Theorem [2] and Theorem [3] proceed exactly the same way. Finally, the proof 
of Theorem [1] is analogous to the proof of the main theorem of |Boul4| . 

2. Recall that, up to the scalings ([ 6 ]), the Hamiltonian CD on the domain T” x B^^ is 
equivalent to the Hamiltonian d?]) on the domain T” x H 3 , so let us consider the latter. We 
define / = /e by 

f{9,I) :=A{9)I-I + eR{9,I) 


6 
















( 10 ) 


so that the Hamiltonian d?]) can be written as 

H{e,I)=u-i + ef{eJ). 

Let us also define the average, with respect to the resonant linear flow associated to w = 
{0,oj) G X of the perturbation by 

:= / f{9u...,ed,ed+i,...,9nj)d9d+i...den 

Jjn-d 

= A{9u...,9d)i-I + eR{9i,...,9dJ). 

The Hamiltonian ([7]), written as in m, is an e-perturbation of a linear integrable Hamil¬ 
tonian, and we have the following resonant normal form. 

Proposition 5. There exist /r* = /i*(n, Ci, C 2 ) and C* = C^{n,Ci,C 2 ) such that if 

0 < /i(e) < p*, 

then there exists a symplectic embedding <1> : x H 2 —)■ T” x Hs of class such that 

H o $(0,1) = a; • I + e/(0i,..., 0^, I) + ep(e)/(0,1) 

with the estimates |<1> — Id|c'i-i(T™xB 2 ) — o,nd |/Ic*-i(T"xB 2 ) — ^*- 

This is a special case of Theorem 1.1 of |Boul3bj . to which we refer for a proof. 

3. The proof of Theorem [1] will follow from direct arguments using the normal form Propo¬ 
sition 0 

Proof of TheoremU^ Under the assumptions of Theorem [U it is sufficient to prove that there 
exist positive constants /tq = To{n,Ci,C 2 ,A*,I^), c = c{n,CuAli^), 5 = d{n,C,,A*,P) 
and C = C{n,Ci,C 2 , A*, P) such that if 

0 < /i(e) < /io, 

then there exists a solution {9{t),I{t)) of the Hamiltonian system associated to d?]) such that 
1(0) = JO, |/(r) - 1(0)1 > |/i(r) - li{0)\ > c, r := 

and 

max |/j(r) - 1^(0) | < Cfi{s). 

d-\-l<j<n 

Indeed, in view of the scalings dS]), this solution (9{t),I{t)) of the Hamiltonian system asso¬ 
ciated to © gives a solution {9{t),I{t)) = {9{t),el{t)) of the Hamiltonian system associated 
to © which satisfies the conclusions of Theorem [TJ 

So let us prove the above statement for the Hamiltonian ©, and to simplify notations, 
we remove the tilde so that the Hamiltonian © now reads 

H{9,1) = Lo-I + eA{9)I ■ I + e^R{9,1) = u ■ I + ef{9,1). 

Fix Iq G M”' such that |/o| = 1 and A*Iq ■ Iq 7 ^ 0. Thus we can find a positive constant 
7 * = 7 *(-^o, A*) such that 

|H*/o • /o| = \d0,A{9*)h • /o| > H- ( 11 ) 
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We first choose //q < A** so that Proposition [5] can be applied: it gives the existence of a 
symplectic embedding < 1 > ; ¥"■ x i ?2 ^ T” x i ?3 of class such that 

H o $(0, 1)=uj-I + eM,..., /) + e^l{e)f{e, I) 


with the estimates 

and 

Recalling that 


|<1> — Id|(^i-i(']r"xB2) — 
I/Ic'-1(T"xS2 ) — 


and that e < /i(e), if we set 

f{9,1) := f{9,1) + e^i{e)-^R{9l, ...,9^,1) 


( 12 ) 


then 

H o ^.( 0 , 1)=u;-I + eA{9i,9^)1 ■ I + e^{e)f'{9,1) 

with 

I/1c'-1(T’>xB2) — + ^ 2 - (13) 

Let us consider the solution {9{t),I{t)) of the Hamiltonian system associated to H o 
with initial condition (0(0),/(O)) = $(0*,/o)) where, abusing notations, we identify 0* G 
with (9*,0) € T” = X Using the estimate (fT^ . and choosing /ug sufficiently small 

with respect also to 7 *, one can ensure that 

|%H(0(O))/(O)-7(0)1 > 37 ;. (14) 


The solution (0(t), 7(t)) satisfies, for any 1 < / < 7 and 7 + 1 < j < n, the equations 

il(t) = -£d0^A(9i(t),. . . ,9d(t))I(t) - lit) - £fi{£)dgj'{9{t),l{t)), 

^ ij{t) = 

9i{t) = 2eA{9i{t),... ,9d{t))I{t) ■ ei + £fj.{£)diJ'{9{t),I{t)), 

9j{t) = ujj + 2eH(0i(t),.. .,9d{t))I{t) ■ ej + £iJ,{£)di^f'{9{t),I{t)) 

where u = {Cjd+i, ■ ■ ■ ,^n) G For some 0 < 7 < 1 to be chosen below, let r = 

From the first three equations of (fT^ . one gets 

max |7;(t) — 7i(0)| < 6(4:nCi + n{£)C') < d{4:nCi + 1), 0 < t < r 


max \Ij(t) — 7j(0)| < 5ijl{£)C' <7, 0 < t < r 

d+l<j<n 

max \9i{t) — 0z(O)| < 6{8nCi + fi{£)C') < 6{8nCi + 1), 0 < t < r 

l<l<d 

provided fig < 1/C". From these last estimates, and the estimate (fTTjl . one can choose 7 in 
terms of n, Ci and 7 * such that 


\deiA{9{t))I{t) ■ I{t)\ > 27 *, 0 < t < r. 


8 



and, assuming /xq < 7 j*/C", one obtains 

\edeiA{ei{t),...,9d{t))I{t) ■ I{t) - £fj.{s)deJ'{e{t),I{t))\ > ej*, 0 < t < r. 
From the first equation of (1151) this implies 


|/.(T)-/.(0)|>57r 

whereas from the second equation, we recall that 

max \Ij{t) — /j(0)| < 5fi{e)C', 0 < t < t. 

d+l<j<n 

This solution of the system associated to FT o $ gives rise to a solution of the system associated 
to H, that we still denote, abusing notations, by It satisfies 1(0) = Iq and, 

requiring that /tq < and /tq < {2C^)~^5C', one obtains from the estimate (fT^ 

that 

and 

max \Ij{t) — /j( 0 )| < 6fi{£)C' /2, 0 <t < t. 

d+l<j<n 

Letting c := 5 ^*/2 and C := 6C'j2, this proves the statement. □ 

4. The proof of Theorem [2] and Theorem [3] are direct consequences from the proof of 
Theorem [TJ 

Proof of Theorem We proceed exactly as in Theorem [H choosing Iq = Cj and thus 7 * = 
—a*/4. The choice of the sign of a* allows us to ensure that 


and hence 

Fi (t) > Fj (0) + c = 1 + c. 

Since Ffc(O) = 0 for 1 < /c < n. A: 7 ^ i, it is easy to observe that |Ffc(r)| < 1 and therefore 


|F(r)| = Fi(r) > 1 + c = (1 + c)|F(0)|. 


□ 

Proof of TheoremlM Once again, we proceed exactly as in Theorem [H choosing an arbitrary 
Fq with |Fo| = 1 and with 7 * = —A*/4. □ 

5. To conclude, let us give the proof of Theorem U following the arguments of [Boul4j . 
which is based on the application of the main theorem of |P5s82j . 

Proof of Theorem 0 In view of the scalings ([ 6 ]), it is sufficient to prove the statement for 
a Hamiltonian FF as in defined on the domain T” x F? 3 . We assume that /xq < T* so 
that Proposition [5] can be applied. Then observe it is sufficient to prove the statement for 
the Hamiltonian FF o <b: indeed, <I> is symplectic and the estimate (|12|) implies that it has a 
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Jacobian arbitrarily close to one, hence the measure estimate for the set of invariant tori for 
H o ^ is equivalent to the measure estimate for the set of invariant tori for H. 

Let us denote H = H o Using the assumption {AA) and proceeding as in the proof of 
Theorem [U it can be written as 

H[e, I)=u-I + eAqI ■ I + I) 

where Aq € Sym(n, M) is a non-singular matrix and with 

I/1c*-1(T"xS2) — 

Up to rescaling time by e, it is sufficient to prove the statement for the Hamiltonian 

e-^H{9,1) = s-^io ■I + AoI-I + I) := Ho{I) + 1). 

The above Hamiltonian satisfies the assumption of Theorem A in [Pos82] . Indeed, the Hamil¬ 
tonian is of class C^~^, with 1 — 1 > Iq > 3n — 1, the integrable part Hq is real-analytic and its 
Hessian at any point is constantly equal to the non-singular matrix 2Ao, hence it is bounded 
by Cl and its inverse is bounded by some uniform positive constant Ci. Assuming that 
< /2 where jl = jl{n,Ci,C') is some positive constant, the statement follows directly 
from Theorem A in |Pos82j . □ 
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